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Abstract 

Let {Xij : € N^} be a two-dimensional array of independent 

copies of a random variable X, and let {A'^,i}„gN be a sequence of natural 
numbers such that lim„_,oo e~'^"Nn — 1 for some c > 0. Our main object 
of interest is the sum of independent random products 

JV„ n 

i=i j=i 

It is shown that the limiting properties of Zn, as n ^ cxd, undergo phase 
transitions at two critical points c = ci and c = C2. Namely, if c > C2, 
then Zn satisfies the central limit theorem with the usual normalization, 
whereas for c < C2, a totally skewed Q-stable law appears in the limit. 
Further, Z„/'EZ„ converges in probability to 1 if and only if c > ci. If the 
random variable X is Gaussian, we recover the results of Bovier, Kurkova, 
and Lowe [Fluctuations of the free energy in the REM and the p-spin SK 
models. Ann. Probab. 30(2002), 605-651]. 
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1 Introduction and statement of results 
1.1 Introduction 

The aim of the present paper is to study the limiting distribution, as n -^ oo, 
of the random variable obtained by adding up a large number iV„ of indepen- 
dent summands, each summand being a product of n independent positive- 
valued random variables. To be more precise, let {Xi^j : e N^} be a 
two-dimensional array of independent copies of a random variable X, and let 
{-^n}n€N be a sequence of natural numbers such that for some c > 0, 

lim e-™7V„ = L (1) 
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Then we are interested in the hmiting properties, as ti — > oo, of the random 
variable 

JV„ n 

i=i j=i 

Setting Yij :— e^'--^ , we may rewrite ^ as Zn = J2i'=i 11^=1 which leads 
to the "sum of independent random products" interpretation mentioned in the 
title of the paper. 

To give a motivation for studying Z„, let us consider the following model. 
Suppose we observe a large number of independent objects whose sizes evolve 
in time. Each object has size 1 at time and grows (or decays) in a random 
multiplicative way. This means that the size of the z-th object at time j is 
obtained by multiplying the size of the same object at time j — 1 by some positive 
random variable Yij, where the variables {Yij : S N^} are supposed to be 
i.i.d. Then the size of the «-th object at time n is given by 0^=1 Therefore, 
Zn may be interpreted as the total size of Nn independently evolving objects 
at time n. Of course, the words "object" and "size" have to be understood 
in a very general sense. For example, one may consider independent particles 
whose mass, charge, or energy changes randomly and multiplicatively due to the 
motion in a random environment. Our limit theorems for Z„ will be applicable 
if the number 7V„ of objects is much larger than the time n, cf. (H]). 

A closely related model is the sum of independent random exponentials 

N 

S^{t)=J2e^'''', (3) 

1=1 

where {Xi,i e N} is a sequence of independent copies of a random variable X. 
The limiting properties of S^it) were studied by a number of authors, mostly in 
connection with Derrida's Random Energy Model, a simple model of disordered 
systems [Hj . Weak and str ong laws of large numbers for (t) as N,t ^ oo 



were proved in [l3|, llSll. [14| . The study of limiting distributions of SN{t) 
began with Schlather j2l| , who considered quantities essentially equivalent to 
Sffit) to obtain a continuous interpolation between the central limit theorem 
and limit theorems for extreme values. To describe his idea, let us consider two 
"boundary" cases. In the first case, assume that N oo, whereas t remains 
constant. Then the limiting distribution of SN{t) is Gaussian by the central 
limit theorem. In the second case, assume that t — *■ oo, whereas N is some fixed, 
but very large constant. Then the sum SN{t) reduces essentially to the largest 
summand and hence, one may expect that in the second case, the distribution 
of SN(t) will be governed by the extreme value theory. Now, Schlather 
considered the intermediate case in which both t and TV tend to oo in some 
synchronized way, and obtained (depending on the law of X) several non-trivial 
families of limiting distributions for SN{t) interpolating between the boundary 
cases. Independently of [21j, the limiting distributions of SN{t) were studied by 
Bovier et al. Q in the case of standard Gaussian X. The authors of [gl were 
motivated by the Random Energy Model and obtained a family of limiting laws 
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similar to the families found in [2l|. The results of [2l[ and [a] were largely 
extended in Q (where, additionally, a new method was introduced and the 
structure of the family of limiting laws was clarified), i, i, 

Let us also 

mention that a picture of limiting laws similar to that found in the papers cited 
above was obtained in a different context in Q , [§] . 

Our aim is to determine the structure of the family of limiting laws for the 
sum of independent random products Zn. If the distribution of X is Gaussian, 
then Zn reduces essentially to the sum of random exponentials SN{t)- In this 
case, we will recover the results of @. 

Remark 1. After the first version of this paper was submitted to the arXiv, 
it has been pointed out to the author by Leonid Bogachev that the results 
of the paper (except for Theorem 2]) have been obtained by M. Cranston and 
S. Molchanov, Limit laws for sums of products of exponentials of iid random 
variables, Isr. J. Math., 148 (2005), 115-136 and O. Khorunzhiy, Limit theorem 
for sums of products of random variables, Markov Process. Related Fields 9 
(2003), 675-686. 



1.2 Notation 

To state our results, we need to recall some facts connected with Cramer's large 
deviations theorem, see e.g. [13, § 2.2]. Let X be a random variable (always 
assumed to be non- degenerate) such that 

ip{t) := logE[e*'^] is finite for all t > 0. (4) 

The function ip vanishes at 0, it is continuous on [0, oo), infinitely differentiable 
on (0, oo), and strictly convex. Define 

/3o := lim if'it) =EX, (3oo ■= hm ip' (t) = esssiip X . (5) 

It may happen that /3o = — oo or /3oo — +oo. 

Let / : {f3o, +oo) (0, +oo] be the Legendre-Fenchel transform of (p defined 

by 

/(/?)= sup(/3t-^(t)). (6) 

The fmiction / has following properties, see [13, § 2.2]. It is finite on (/3o,/3oo), 
and we have /(/3) = +oo for f3 > j3ao- On the interval (/3o, /?oo), the function / 
is strictly increasing, strictly convex, and infinitely differentiable. If /3oo 7^ +oo, 
then I{Poc) — lim^i^^ a-nd the value I{Poc) may be both finite and infinite. 
Let P = ip'{a) for some a > (note that this implies that /3 S {(3o,(3oc))- Then 
the supremum in ([6]) is attained a,t t = a and hence, 

liifi'ia)) ^ aip'ia) ~ ip{a), a > 0. (7) 

We will see that the limiting properties of the sum of independent random 
products Z„ undergo phase transitions at two "critical points" c = ci and c — C2 
given by 

ci :=/(^'(l)) = ^'(l)-^(l), C2 := /(^'(2)) = 2^'(2) - ^(2). (8) 
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The function a I{}p' {ci)\ a > 0, is strictly increasing. Therefore, < ci < 
C2 < oo. 



1.3 Results on limiting distributions 

Our first theorem shows that for c > C2, the sum Zn satisfies the central limit 
theorem. 

Theorem 1. Suppose that ([T]) and ^ hold, and assume that c > C2. Then 
Zn —^Zn V 



•7V(0,1), n 



At the critical point c = C2 the limiting distribution is still Gaussian, but 
with variance 1/2. 

Theorem 2. Suppose that ([T]) and ^ hold, and assume that c = C2. Then 

Zn — EZn V 



/VaFz; 



■A/'(0,l/2), n 



The next theorem shows that for c < C2, the central limit theorem breaks 
down and instead, a totally skewed a-stable distribution appears in the limit. 
To state it, we need to assume that the distribution of the random variable X 
is non-lattice. Recall that a random variable X is called lattice if there exist 
/i, a g R such that the values of X are a.s. of the form /in + a, n S Z. 

Theorem 3. Suppose that ([T]) and ^ hold, c € (0,C2), and assume that the 
distribution of X is non-lattice. Define a € (0, 2) as the unique solution of the 
equation I{ip'{a)) — c, and let (3 — ip'{a). Set 

rEZ„ = iV„e'^«", z/ce(ci,C2), 
An = I iV„E[e'^" ls„<fc„], «/ c = ci, where Sn = Zl"=i ^ij' (9) 
[o, z/ce(0,ci), 

e''", where 6„ = f3n — log ^a\/27r(p"(a)n^ . (10) 



B 



Then 



— An V 

> J^a, n 



where J- a is an a-stable distribution with skewness parameter +1. The charac- 
teristic function (pa of Ta is given by 



log (u) 
where 7 is the Euler constant. 



— r(l — q;)|m|" exp (— i-|asgn(u)) , if a ^ 1, 
iu{l - 7) - \u\ (§ + i sgn(u) log \u\) , if a ^ 1, 
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Remark 2. To see that the equation /(</?' (a)) — c has a unique solution a for 
every c € (0,C2), note that the function a i-^ /(</?' (a)), a > 0, is continuous and 
strictly increasing, and that lima^o+ I {^'{ct)) = 0. For the latter fact see e.g. 
Eq. 2.2.8 in 0. 

Remark 3. It will be shown in Section that in the case c — ci, the sequence 
A„ satisfies, as n — > cxd, 

(11) 

The right-hand side of (fTT|) provides an alternative way to choose A„ in the case 

c — Ci. 

In the next theorem we describe what happens if the distribution of X is 
lattice. As we will see, in this case there is no convergence to an a-stable 
distribution. Instead, a family of infinitely divisible distributions with discrete 
Levy measures appears as the set of accumulation points of the appropriately 
normalized sequence Z„. Since Z„ changes only by a constant factor e^"° if we 
replace X hy X — a, there is no restriction of generality in making the following 
assumption. 

Assumption 1. There is /i > such that the values of X belong with proba- 
bility 1 to the lattice hZ, = {hn : n € and, moreover, h is the largest number 
with this property. 

It will be convenient to use the following notation: for 6 e M we set 

[b]h ■■= max{a ehZ:a<b}, {b}h ■= h - [b]h G [0, h). 

Theorem 4. Suppose that ([T]) and ^ hold, c e (0, C2), and let Assumption{^be 
satisfied. Define a G (0,2) as the unique solution of the equation I(Lp'{a)) — c, 
and let (3 — ip'{a). Define An as in ([9]) and set 



B„. = e''" 



where bn — /3n — a ^log(ji ^ ^/2Trip"{a)n^ . (12) 



Define A„ ~ {bn}h cind let {rifcjfceN be an increasing integer sequence such that 
A := limfe^oo exists. Then 



7, —A 



V 



^a.A, k ^ 00. 



Here, J^a.A is an infinitely divisible distribution whose characteristic function 
4>a.A has a Levy-Khintchine representation 

^og(j)a,Aiu) = iCa,AU+ ^ (e™^ - 1 - iua;la;<i) x"" , 

2:(iCxp(/iZ— A) 

where exp(ft,Z — A) denotes the set {g''""^ : n G Z}, and Ca,A is some constant. 
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Corollary 1. Under the assumptions of Theorem^ 




is a tight sequence of random variables. 
1.4 Weak laws of large numbers 

In this section we state our results on the stochastic convergence of Z„ and the 

associated "finite-scale free energy" (1/n) logZ„. We denote by convergence 
in probability. 

Theorem 5. Suppose that ([T]) and ^ hold. Then, as n ^ oo, 



Remark 4. It will be shown in Section that in the case c < ci there is no 
sequence a„ with Z„/a„ ^ 1 as n — > oo. 

In the next theorem we compute the crude logarithmic asymptotics of Z„. 
If the distribution of X is Gaussian, we recover a result of [13j , see also [18|] , on 
the free energy in the Random Energy Model. 

Theorem 6. Suppose that ([l} and ([4]) hold. Then, as n ^ oo, 



where I ^ denotes the inverse function of I . 

It was pointed out in [13] that an analogue of Theorem [5] for the sum of 
random exponentials 5'jv(^) can be seen as a third-order phase transition in 
the Random Energy Model. The next proposition shows that the third-order 
character of the phase transition is preserved if SN{t) is replaced by Z„. 



Proposition 1. Let f^{c) — (p(l) -I- c and /+(c) = / ^{c). Then /-(ci) = 
/+(ci) and f'_ici) = /;(ci), but f'l{c^) ^ f';{c,). 



1.5 Example: Uniform stick breaking 

Let us compute the critical points ci and C2 explicitly assuming that Y e^ 
is uniformly distributed on the interval [0, 1]. To give a motivation, imagine a 
large number Nn of sticks of unit length and mass. Suppose that each stick is 
broken at a uniformly distributed point, resulting in two fragments. One of the 
fragments, say the right one, is ignored, whereas the left one is again broken at 
a uniformly distributed point, and the procedure is repeated n times for each 




(13) 




(14) 
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of the Nn sticks. The total mass of the Nn (very small) fragments obtained in 
this way after n steps is given by Zn defined in ([2]) with being uniformly 
distributed on [0, 1]. To compute ci and C2, note that 

Lp{t) = logE[e*^] = logE[F*] = log / y*dy = - log(l + t). 

Jo 

Hence, ip'{t) = —l/{l + t). It follows from ([5]) that the critical points ci and C2 
are given by 

ci =log2-i«0.19, C2 =log3- ^ «0.43. 

An easy computation shows that /3o = —1, Poo = 0, and J(/3) = —(1 + /3) — 
log(— /?) for (3 e (—1,0). For example, Theorem [H] yields, as n — > oo, 

1 V jc-log2, ifce[ci,oo), 

— log Zn S 

n [-7(c), ifce(0,ci], 

where 7 = 7(c) is defined as the unique solution of the equation 7 — log 7 = 1 + c 
in the interval (0, 1). 

Of course, similar explicit calculations can be done in a number of further 
special cases, e.g. if Y is B- or F-distributed. 

1.6 Heuristic arguments 

Some of the above results admit a natural non-rigorous interpretation. First, 
we give a non-rigorous argument justifying Theorem [5) There are two natural 
ways to try to guess the limit of (l/n)logZ„ as n — > 00. The first way is 
to assume that Zn is well approximated by its expectation. This leads to the 
approximation 

- logZ„ « - logEZ„ « - log (7V„e'^(i)") « ^(1) + c. 

By Theorem ini this gives a correct result provided that c G [ci, cx)). The second 
way is to assume that Zn is dominated by the maximal summand in ([5]) . It can 
be shown that 

1 -p 

— max Sin^I^^{c), n ^ 00, (15) 

n i=l,...,N„ 

where Si^n = J2^=i -^ij- This leads to the approximation 

-logZ„w-log( max e^-" ) w - log fe^^'^")") = /-^(c). 
n n \i=i,...,Nn J n \ J 

By Theorem ini this gives a correct result provided that c € (0, ci]. 

Let us return to p5)) . It may be thought of as a simphfied (decoupled) 
version of the Erdos-Renyi law of large numbers, see e.g. 0, Theorem 2.4.3]. A 
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statement which is more precise than (|15l) was proved in Theorem 2 of 16| (see 



also ll|) where it was shown that the left-hand side of p5|) has limiting Gumbel 
distribution. Moreover, it was shown there that the upper order statistics of 
the sequence {Si^n}i!^i can be approximated, as n — > oo, by the point process 
{a~^Ui + bn}'^i, where {Ui}°Zi is a Poisson point process on R having intensity 
e~"du, and a and 6„ are as in Theorem[3] Hence, we obtain an approximation 



Ui 

= 1 



At least for a e (0, 1), the right-hand side converges a.s. and has an a-stable 
distribution with skcwness parameter +1. This gives a non-rigorous justification 
of Theorem [3] in the case a S (0, 1). This argument is close to the approach 
used in [2lj and @, and could be turned into a rigorous proof. However, we 
prefer to proceed in a different way. Our proof of Theorem [3] will be based 
on two ingredients. The first ingredient is the classical summation theory for 
triangular arrays of independent random variables [l5| . This approach is rather 
natural in view of the triangular array structure of ([2]), and was suggested in Q. 
The second ingredient is a precise version of Cramer's large deviations theorem 
which will be recalled in Section [51 

1.7 Organization of the paper 

Theorems [H d [3 H will be proved in Sections El H El El respectively. The 
weak laws of large numbers of Section 11.41 will be then derived in Section [71 as 
consequences of the results of Section 11.31 



2 Facts about precise large deviations 

Throughout the rest of the paper let {Xi : i E N} he i.i.d. copies of a random 
variable X satisfying and denote hy Sn ^ Xi + ... + Xn their partial sums. 
The following theorem on the precise asymptotic behavior of large deviation 
probabilities for sums of i.i.d variables due to 1] and 19] will play a crucial role 
in the sequel. 

Theorem 7. Suppose that ^ is satisfied. Let (3 € {Po,Poo) o,nd define a > 
to he the unique solution of the equation f'{a) = [3. 

1. Assume that the distribution of X is non-lattice. Then 

f[Sn > n(3] ^ n ^ oo. 

2. Assume that the distribution of X is lattice, and that Assumption [7] is 
fulfilled for some h > 0. Then the following holds if (3 E n'^^h'L: 



= nf}] 



8 



Both statements hold uniformly in (3 € K for any compact set K C (/3o, Poo)- 

The next lemma holds both in the lattice and in the non-lattice case. 

Lemma 1. Suppose that ([4]) is satisfied. Let K he a compact subset of (/3o, /3oo)- 
Then there is a constant C depending on K such that for all f3 Cz K and for all 

P[5'„ > np] < Cn-i/2g-«/(/3)_ 

Proof. In the non-lattice case the lemma follows immediately from Part [1] of 
Theorem [71 In the lattice case, we assume that there exist a S K and h > 
such that the values of X belong a.s. to the lattice a + /iZ, and that h is 
maximal with this property. It was proved in Part II of Theorem 6 in [l^ that 
the following asymptotic relation holds uniformly in /3 e if as long as the values 
of /3 are restricted to the lattice a + hn~^lj: 

For general (3 & K set 

Pn = max{a; £ a + hn~^Z : x < /3}. 
Note that /?„ > /3 — hn^^. Then, by convexity of /, 

HPn) > HP) + I'{P){Pn -P)> I{P) - hn-H'{p) > I{P) - mn-\ (17) 
where m is a constant which is uniform in P Cz K. We have, evidently, 

F[Sn>nP]<¥[Sn>nP„]. (18) 
Applying to the right-hand side of (fT8|) first (fT6|) and then (|17p . we obtain 

> np] < Cin-i/2e-«^(^^) < Ciri-i/^e-"^^^^)-™"") < Csn-i/^e-"^^''). 
This completes the proof in the lattice case. □ 

The next two lemmas are standard. 
Lemma 2. For every P > Pq and every n Cz N, 

¥[Sn>nP]<e-"'^^l (19) 
Proof. For every fixed t > 0, the Markov inequality yields 

^Sn > nP] < e-"'3*E[e*'5"] = e~"(''*"'^(*». 
Recalhng that by I{P) — supt>Q(/3i — fit)), we arrive at ([TO)) . □ 
Lemma 3. For every a > 0, we have I'{ip'{a)) = a. 
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Proof. Let /3 G (/3o,/9oo)- Denote by 6{f3) the unique solution of the equation 
(p'{9{/3)) = (3. Then the supremum in ([6]) is attained at i = 9{(3) and hence, 

= mfi) - ^{om- 

We will show that /'(/?) = 6l(/3). We have 

/'(/?) = (50(6) - ^{0my\,^0 = eiP) + pe'iP) - ^'{9{f3))9'i(3) = 0(/3). 



Setting P = (p'{a) and taking into account that ip'{9[a)) 
statement of the lemma. 



a, we obtain the 
□ 



The next theorem gives a first term in the asymptotic expansion in the 
central limit theorem, see Theorem 5.22 of [2^. The only place where we will 
use it is the proof of Remark [3] in Section 14.41 

Theorem 8. Let {Xi,i e N} be i.i.d. zero-mean random variables having a 
non-lattice distribution and finite third moment. Let /X2 = EX^ and = MXf. 
Then, uniformly m a; S R, 



Here, $(a;) 
tion. 



Sn 



< X 

(2^)-V2J- 



$(a;) 



x^)e-^ 



oo. 



* /^di is the standard normal distribution func- 



3 Proof of Theorem [T] 

The proof will be based on the classical summation theory for triangular arrays 
of independent random variables, a method suggested in [3]. Recall that {Xi : 
i G N} are i.i.d. copies of a random variable X satisfying ([l]), and that Sn = 
Xi + . . . + Xn. For n E N define a positive- valued random variable ]¥„ by 

Wn = e^"-", where 6„ = + (20) 

Let Wn,i, . ■ . , Wn.N„ be independent copies of the random variable Wn- Then 
Zji has the same distribution as e^" X^i^Ti ^n,i: and we can restate Theorem [T] 
in the following equivalent form: 

N„ 

J2Wn,^-NnnWn]^U{0,l), n^(X3. (21) 
i=l 

To see that (|2ip is indeed equivalent to Theorem [H we need to show that 
VarZ„ ^ e^*" as n — > oo. This can be done as follows: 

VarZ„ = 7V„(E[e2'5"] - E[e^'^"]^) = iV„(e^(2)« _ g2^(i)n-) _ ^^eV(2)« ^ g2b„^ 
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where we have used that by strict convexity of Lp{2) > 2(p{l). 

From now on, we concentrate on proving (j21[) . According to Theorem 4.3 on 
p. 119 of [iOl, the convergence in ([^T)) will be established after we have verified 
that the following three conditions hold for every r > 0: 

lim Nr,P[Wn > r] - 0, (22) 

lim iV„Var[VF„lw„<r] = 1, (23) 

n— i-oo 

lim NnE[Wnlw„>T] = 0. (24) 

n^oo 

3.1 Proof of (123) 

Define /3„ = (6„ + logT)/n. Recalling ([20)1 and using Lemma [H we obtain 

NnP[Wn >t]= NnF[e^--'" > t] = N„¥[Sn > n/3„] < iV„e-^('5")". (25) 

Recall that by (H]), Nn ^ e"^" as n — > oo. To prove (P^ . it suffices to show that 
for some e > 0, /(/?«) > c + e provided that n is large. We have 

lim = i(c + <^(2)) - i(c2 + </7(2)) + i(c-C2) -</.'(2) + i(c-C2), 

n^oo Z Z Z Z 

where the last equality follows from ([5]). 

Note that /((/?' (2)) = ca by dH]), and /'(<^'(2)) = 2 by Lemma H For every 
a > we have 

I{ip'{2) + a)>C2 + 2a. (26) 

Indeed, if <p'{2) + a > f3oc, then the left-hand side of (pS)) is infinite, whereas 
the right-hand side is finite, so that ([26]) holds. If <p'{2) + a < /3oo, then (|26|) 
follows from the strict convexity of / on (/3o,/3oo]- By lower semi-continuity of 
/, and by ([26|) . we have 



liminf /(/3„) > / L'(2) + i(c - ca) ) > C2 + (c- C2) = c. 

Thus, there is e > such that /(/3„) > c + e provided that n is sufficiently 
large. Therefore, the right-hand side of (^5)) converges to as n ^ 00. This 
proves 



3.2 Proof of ([23]) 

Fhst note that by ([20ll . 

E[W2] = E[e2(^^"-''")] = e^(2)n-2&„ ^ -^/^^^^ ^27) 



In view of this, in order to prove ([23| . it suffices to establish the following two 
equalities: 

lim N„E[W^lw„>r] = 0, (28) 

n — *oo 

lim N^/^E[W„lw„<r] = 0- (29) 
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Let us prove first. We have 

By strict convexity of (p, we have (p{l) < (p{2)/2. This proves (|29p. Let us 
prove (UHl). By Lemma 4.2 of [1], we have for every S > 0, 

E[W^lw„>r] < T'^^E[W^+^^]. 

Thus, it suffices to show that for some (5 > 0, 

lim 7V„E[H/2+25] ^ Q ^30) 

n — >oo 

We have 

E[W^+^'] = e-(2+2«)''"E[e(2+2*)^"] = e^^-W", (31) 
where c„((5) = (2 + 25){b„/n) - ip{2 + 25). Recalling (gOl), we obtain 
lim cn{5) = {\ + 6){c + (p(2)) - ^(2 + 26). 

n — ^oo 

Denote the right-hand side by c{S). As (5 — > 0, we have (p{2 + 25) = ip{2) + 
2S(p'{2) + o{S). Hence, as (5 ^ 0, 

c{S) + d{c + ip{2) - 2^'(2)) + o{5) ^c + S{c- ca) + o{d). 

Since c > C2 by the assumption of Theorem [U we can choose S > such that 
c{S) > c. It follows that there is £ > such that c„ (J) > c + e provided that n 
is sufficiently large. Recalling (|3ip . we obtain for large n, 



By dH), the right-hand side tends to as n — > oo. This proves (|30| and (|28|l . 
3.3 Proof of ([24]) 

Again using Lemma 4.2 of j2|, we obtain that for every 5 > 0, 

iV„E[W„lw„>r] < NnT-^-^'E[W?+^']. 
By (|30l) . the right-hand side converges to as n ^ oo. 

4 Proof of Theorem [2] 

The proof follows the same idea as the proof of Theorem (TJ but requires more 
subtle estimates. Let Wn and 6„ be as in (|20p . By Theorem 4.3 on p. 119 of [20j . 
it suffices to check that for every r > 0, the following three conditions hold: 

lim NnF[Wn > r] = 0, (32) 

lim Ar„Var[VK„lw„<,] = 1/2, (33) 

lim N^E[Wnlw„>r] = 0. (34) 
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4.1 Proof of ([32D 

Set ^„ = (6„ + log r)/n and /3 = 1^9' (2). Note that by ([5]), J(/3) = 2/3-^(2) and, 
by Lemma [21 /'(/3) = 2. By convexity of / and ([^O)) . wc have 

> HP) + I'mPn -P) = ^(logA^n + 21ogr). (35) 

Note that by ^ and ([8]), 

Hm /3„ = i(c2 + (^(2)) = (^'(2) - /?. (36) 

n — ^oo Z 

Note also that fi = <y£''(2) e (/3oj/3oo)- Hence, Lemma [T] yields 
P[l^„ > r] = P[5„ > n/3„] 

4.2 Proof of ([33]) 

Exactly as in the proof of Theorem [1] see ((29l) , it can be shown that for every 
r > 0, 

lim iVy2E[W^„V„<,] =0. 

n — >oo 

In view of IE[W,j] — 1/Nn, see (|27|) . in order to prove ([33]). it suffices to show 
that for every r > 0, 

lim NnnW^lw^<r] = 1/2. (37) 

n — ^oo 

Recalling that 6„ is given by ([20]) . we write 

lim N^E[W^lw„<r] ^ lim e'°s^"-^'>"E[e^^-ls„<b,^+iogr] 

n — ^oo 

Applying Part [1] of Lemma H] below to the right-hand side yields ([571) . The fact 
that the sequence 5„ + log r satisfies the assumption of Part [H of Lemma IH can 
be seen as follows: By ([1]), we have, as n ^ oo, 

log7Vn + (^(2)n C2n + ip{2)n 
On = ^ = ^ + o(l) = If (2)n + o(l). 

Hence, 6„ + logr — (f'{2)n + 0(1) as n — + oo. 
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4.3 Proof of (E 



Denote by Fn the distribution function of the random variable Sn bm and let 
Fn{y) — l~ Fn{y) be the tail of i^„. To shorten the notation, we write t — logr. 
We have 

/oo 
e^dFr^iy). 

We take a sufficiently small but fixed e > and write 

N„E[Wnlw„>r] - 4^\t,e) + Ji^\s), (38) 

where 

pen poo 

J«(i,e) = 7V„/ eydF.r,{y), 4^\£) ^ N.J eydF,,{y). 



First we prove that for fixed t e R and £ > 0, 

lim Ji^\t,e) = 0. (39) 

n — s-oo 

Using that dFn{y) — —dF^iy) and integrating by parts, we obtain 

^en _ _ en f^" 

J«(t,£) = -7V„ / eydFr,{y)^-Nr,Fn{y)ey + NMy)eydy. (40) 



Take any y S [t,en] and let /?„ = (6„ + y)/n. As in ((36|) . lim„^oo = It 
follows that for sufficiently large n, fin & [/3 — 2e,/3 + 2£]. If e is sufficiently 
small, then Lemma [T] implies that for some constant C > 0, 

NMy) = NnnSn > < C7V„„-i/2e-/(/3.)". 

As in ([551). 

/(/?«)> ^ (log iV„ + 2y). (41) 

It follows that for all y G [i, en], 

NnFn{.y) < Cn-^l^e-^y. 

Inserting this into the right-hand side of (PO]) and letting n ^ oo yields (|39p . 
To complete the proof of ([M]) . it suffices to show that for every £ > 0, 

lim J^^^e) = 0. (42) 

Using first Lemma [2] and then ([4T|l . we obtain the foUowing estimate: 

iV„i?„(2/) < iV„e""^(^") < e-^y. (43) 
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Let Kn be the set [sn, oo) H Z. We have 

J en 

<iV„ ^ e^(Fjj)-Fjj-l)) 
<iV„ e^KU-l). 

3&K„ 

By (gSl), iV„f'„(j - 1) < e2e-2J. Hence, 

By letting n ^ oo, we obtain (|42|) . The validity of (p4|) follows from the 
decomposition ([55)1 together with ([55)1 and 



4.4 Computations with truncated exponential moments— 1 

In this section we prove a lemma on the asymptotic behavior of truncated ex- 
ponential moments of sums of i.i.d. random variables. Part [1] of the lemma was 
used in Section [4?2l whereas Part[2]will be needed only in the proof of Remark[3l 
Recall that {Xi,i G N} are i.i.d. copies of a random variable X satisfying the 
moment condition (jj]), and that 5„ = Xi + . . . + Xn are their partial sums. 

Lemma 4. Let a > and set (3 — ^p'{a). Let bn be some sequence, and set 
M„(n) = e-'^(")"E[e"^"ls„<6j. 

1. Suppose that bn = f3n + Tn, where rn = o(v^) as n ^ oo. Then 

lim Ma{n) ^ \. 

2. Suppose that 6„ = /3n + r„, where r„ — o(n^^^) as n oo, and assume 
that the distribution of X is non-lattice. Then, as n oo , 

MJn) = - H , r„ + ^ \ \ + o ' 



Proof. The idea of the proof will be to use an exponential change of measure 
argument. This will allow us to reduce Part [1] of the lemma to a statement 
following from the central limit theorem. Part [2] will require the more subtle 
Theorem |S1 

Denote by F the distribution function of X. Let {X^, z S N} be independent 
copies of a random variable X whose distribution function F is given by 



dF{t) 
dF{t) 



(44) 
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Denote by F„ and Fn the distribution functions of 5„ and Sn :— Xi + . . . + X„, 
respectively. Then it is weU known (see e.g. the lemma on p. 74 of 12]) that 



dF„{t) 



^at — ip{a)n 



It follows that 
M„(n) 



dF„(i) =P[^„ <5„]. 



(45) 



This reduces the study of the truncated exponential moment Ada {n) to the 
study of the probability P[S'„ < Asymptotic properties of this probability 
will be derived by means of the central limit theorem applied to the sum Syi- 

First of all let us compute EX and VarX. Recall that ip{t) — logE[e*^] and 
set (p{t) = logE[e*^]. By (gH), we have 

(p{t) = log / e'^'dPi^x) = log / e*^e"^-'^(")di^(x) = ip{t + a) - ^{a). 

Hence, 

EX ^ip'{0)^ip'{a)^P, Varl = (^"(0) = (^"(a). (46) 
It follows that E5„ = Pn and VarS'„ ~ Lp"{a)n. We may write 

(3n 



< bn] = 



^ Lp"{a)n \J Lp"[a)n 
where we have used the notation 

Sn - (in 



= $„(a;„), 



y/ip"{a)n 



< X 



(47) 



(48) 



Now we are ready to prove Part [T] of the lemma. If r„ = o(-\/n), then 
lim„_^oo Xn = 0, and the central limit theorem applied to Sn shows that $„(x„) 
converges to 1/2 as n — > oo. Hence, 

lim Ma{n) = lim P[S'„ < b„] = lim $„(a;„) = 1/2. 

n — ^oo n — >OG n — ^oo 

To prove Part [2] of the lemma, we need to obtain an asymptotic formula for 
the probability P[S'„ < 6„] with an error term of the form o{l/ ^/n). To this end, 
we apply Theorem [8] to the centered variables {Xi — (3,i G N}. Recalling (|46p 
and using the well-known equality of the third cumulant and the third centered 
moment (see e.g. Eq. 26 on p. 66 of 15]), we obtain 

:= E[(l - /3)2] = ^"(a), := E[(l - /3)3] = ^"'(0) - ^'"(a). (49) 

Applying Theorem [Sj we obtain 

^n{Xn)^^[ 



A*3 



6\/27rn/i2^^ 



00. 
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The standard normal distribution function <J>(x) = {2tt) ^^"^ e * satis- 
fies 

= - + ^= + 0(a;2), x^O. (50) 
2 V 27r 

Since r„ = o(n^/'') by the assumption of Part [21 we have — o{l/^/n) as 
n ^ oo. Hence, 



2 ^27r^"(a)n 6\/2^^2 



To complete the proof of Part [5] of the lemma, recall that fj,2 and /ia are given 
by (gl]). □ 

Proo/ of Remarkl^i By dH]), we have A„ = NnE[e^"ls^<b„], where 6„ is given 
by pO| . The statement of the remark follows by applying Part [2] of Lemma |4] 
with a = 1. □ 

5 Proof of Theorem [3] 

By the statement of Theorem |31 we assume that c G (0, C2). Recall that a € 
(0,2) is defined as the solution of the equation I{ip'{a)) — c, that f3 = (p'{a), 

and that 

6„ = logB„ ^(3n- a-^ log (^ay/2T:ip" {a)nj . (51) 

Define a positive-valued random variable Wn by 

W„ = B-ie^" =e^"-''". (52) 

Let W^„,i, . . . , Wn,N„ be independent copies of Wn- With this notation, Theo- 
rem [3] is equivalent to the following statement: 

J2Wn,^-B-^Ar,^J^a, n^OO. (53) 

1=1 

By 0, Section 6], the convergence in (|53)) will be established once we have 
verified the validity of the following three statements: 

1. For every t > 0, 

lim N,J[Wn >t]= T-". (54) 



2. We have 



3. For every r > 0, 



lim limsupiVn Var[l/l^„lw„<^] = 0. (55) 



D^{t) := lim iNnE[Wnlw^<r] - B'^ A^) = \ i^"^' !^ " \' 

n^oo I logr, if a = 1. 

(56) 

Our proof of the above conditions will be based on lemmas whose statements 
and proofs are postponed to Section [5T4l below. 
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5.1 Proof of ([MD 

Since W„ = e"^""''" by wc have 

iV„P[VK„ > r] - A^„P[5„ - 6„ > logr]. 

By Lemma [5] below with y — logr, the right-hand side converges to t~" as 
n — > oo. 

5.2 Proof of (ES]) 

Since Var[W„lvF„<r] < IE[1V^1w^<t-], it suffices to prove that 

hm hmsupiV„E[Ty,^lvK„<r] = 0. (57) 

Recall that by (HI]), W„ = e-^""^". We have 

7V„E[l¥2jv^^<,] = 7V„E[e2(^"-''")ls„<;,„+iogr]. 

recall that a € (0, 2). Applying to the right-hand side Part[l]of Lcmma[7]below 
with K = 2 and t — logr, we obtain 

lim N„E[W^lw„<r] = TT^r^-". 

n— >oo Z — Oi 

Then ^ follows by letting t ~>0+. 

5.3 Proof of (EED 

Let us assume first that a € (0,1) (which is equivalent to c € (0, ci)). Then 
by dS]), An = 0, and 

D^{t)= lim Ar„E[e^"-''ns„<6„+iogr]. 

n — >QO 

Applying to the right-hand side Part [1] of Lemma [7] below with k — 1 and 
t = logr, we get the statement of ([55]) in the case a G (0, 1). 

Now assume that a G (1,2) (equivalently, c G (ci,C2)). By B^^^A^ = 
iV„E[H/„] and hence, 

D^{t) = lim (7V„E[W^„lM/,.<r] - iV„E[W„]) 

= - lim KrM[Wnlw^>r\ 

n— >oo 

= - lim 7V„E[e^"-''"ls„>fc„+iogr]. 

n — >OQ 

Applying to the right-hand side Part [2] of Lemma [7] below with k = 1 and 
t = logr, we get the statement of ([55]) in the case a G (1, 2). 
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Finally, let us consider the case a = 1. By B.^^An ~ A'^;^E[W„lw„<i]. 
For concreteness, assume that r > 1, the proof in the case t < 1 being analogous. 
Then 

D^{t) = lim (iV„E[W„lw„<r] - N„E[Wnlw^<i]) 

n — 'OC' 

= lim NnE[Wnlw,,e(i,T\] 

n — >oo 

= lim iV„E[e^"-''"lb„<s„<b„+iogr]. 

n — >oo 

Applying to the right-hand side Part [3] of Lemma [7| below with k = 1, ti = 0, 
t2 = logr, we get the statement of (|56l) in the case a = \. This completes the 
proof of ([55]) . 



5.4 Computations with truncated exponential moments— 2 

In this section we prove several lemmas on truncated exponential moments 
for sums of i.i.d. variables. These lemmas were used in the above proof of 
Theorem[3l Let Coo = limQ^+oo (<^'(a))- 

Lemma 5. Suppose that JT]) and ^ hold and that c G (0, Coo). Let a be the 
solution of the equation I{ip'{a)) = c, set [3 — (p'{a), and let bn be defined 
by (|5ip . Assume also that the distribution of X is non-lattice. Then for every 
y GM. we have 

lim N„F[Sn -br,>y]^ e'"^. (58) 



n — ^OG 



As long as y stays bounded, the convergence in (j58p is uniform in y. 

Proof. Let /3„ = (fe„ + y)/n and note that lim„^oo — (3. By Theorem [7] (see 
in particular, the uniformity statement in its formulation), we have 

¥[Sr^-br,>y] , ^ e-"^(^"), n->oo. (59) 

ay'2T:ip" [a)n 

To complete the proof, we need an asymptotic formula for n/(/3„) as n — > oo 
with an error term of order o(l). Using Taylor's expansion of the function / at 
the point (3 we obtain 

/(/?„) = /(/3) + I'miPn - /?) + 0((/3„ - /?)'), n ^ oo. 

Recall that /(/3) = c and by LemmaEl I'iP) = a. Noting that by (3^-13 = 
o(l/^/n) as n — > oo, we obtain 

nI{Pn) = cn — log (^a\/ 2TTip" {a)ri^ + ay + o(l), n ^ oo. (60) 
Applying ([50)1 to the right-hand side of (|59p . we obtain that 

P[5„ - hn > y] ~ e~"'e~°'y, n oo. 
To complete the proof of ((58|) . recall that by ((T]), iV„ ~ e'^" as n — s- oo. □ 
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The next lemma gives an estimate for the probabihty P[5'„ — 6„ > y] which 
is vahd uniformly for y € [—en, en], where e > is a fixed small number. 

Lemma 6. Suppose that ([T|) and Q hold and that c G (0,Coo). Let a be the 
solution of the equation I{ip'{a)) — c, set (3 = ^p'{q), and let bn be defined 
by (j5ip . If e > is sufficiently small, then there is a constant C > such that 
for all n Cz N and all y £ [—en, en], 

iV„P[5„ - 6„ > y] < Ce-'^y. (61) 

Proof We have P[5„ - 6„ > y] = P[S'„ > n/3„], where /3„ = (6„ + y)/n. Since 
it is assumed that y € [—en, en] and since by (jSTjl . lim„_,(x> ^n/jT- = /?, we have 
f3n & {P — 2e, /3 + 2e) provided that n is sufficiently large. By convexity of the 
function /, 

n/(/3„) > n/(/3) + n/'(/3)(/3„ - /3) = cn - log (aV2^<P"(a)'^) + ^V- (62) 
Using first Lemma [1] and then ([S^ . we obtain 

Vn i/n 

This completes the proof of ((6T|) . □ 

Lemma 7. Let t/ie assumptions of Lemma\^ be satisfied. Then the following 
three statements hold true. 

1. Let K > a. Then for every t G M, 

lim iV„E[e^(^"-^")l5„<6„+t] = ^—e^'^-"^*. (63) 

n^oc K — a 

2. Let < K < a. Then for every t G R, 

lim 7V„E[e''(^"-''")ls„>6„+t] = —e'-^-'^^K (64) 

n—>oo K — a 

3. Let K = a. Then for every ti <t2, 

lim 7V„E[e"(^"~''"hb„+t,<s„<6„+tJ = n{t2 - ti). (65) 

n — s-oo 

Proof. Let us start by giving a non-rigorous proof of Part [1] To shorten the 
notation, we set 

J„(i) = 7V„E[e«(^"-''")ls„<6„+t]. 

Let Fn{y) = P[5'„ — < J/] be the distribution function of the random variable 
Sn ~ bn- By Lemma [SJ we have for each fixed y G M, 

l-F„(y)^iV-ie-"^ n^oo. 
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Differentiating this formally, we obtain dFn{y) ^ N^^ ^ae "'^dy as n ^ oo. Now 
we can compute the limit in ((63)) as follows: 



ae 



{K.-a)y 



dy 



Note that the integral e*^'^~"^ydy is finite since k > a. In a similar way, 
it is also possible to give non-rigorous proofs of Parts [2] and [3] of the lemma. 
However, making these arguments precise requires some work. 

We start by proving ([55)1 . Take a large number T > and a small number 
e > 0, and set A = (3 — (3o — e (recall that /3o was defined in ([5])). We have a 
decomposition 



Jn{t)=N„ 

where 



^ydF^iy) = ji'\t,T) + ji'\T,s) + 4Pis) + (66) 



7V„e«^dK(y), 

T 

Nne^ydFr^iy), 
Nne^ydFniy), 



en 

— 671 



An 

-An 



N^e^ydFr^iy). 



First let us show that 



hm limjW(t,T) = 

T— i'+oo n— i-oo 



(67) 
(68) 
(69) 
(70) 

(71) 



Let Fn{y) = 1 — Fn{y) be the tail of F„. Noting that dFn{y) — —dFn{y) and 
integrating by parts, we obtain 



4^Ht,T)^- e'^yNr^dFr.iy) 



(72) 



e^^NMy) +n NMy)e^ydy. 



-T 



By Lemma El the following relation holds uniformly in y S [— T, i]: 

lim 7V„F„(y) = e-"'^. (73) 

n — >oo 

Applying ([73]) to the right-hand side of (I72p . we obtain 
lim J^^\t,T) = -e^''-")?^ * + 



-T 
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After letting T +00 this yields ([7T|) . 

To complete the proof of ([63]) . we need to show that the terms J„ (T, e), 
Jn^''(£), and J^\e) are in some sense negligible. First we prove that for each 
fixed e > 0, 

lim limsupJ^^\T,e)^0. (74) 
Integrating by parts as in ([7^ . we obtain 

42)(r,£) ^ -e«^iV„F„(y) + K / NnFniy)e''ydy. (75) 

-en J_£„ 

By Lemma [51 there is a constant C > such that for all n £ N and all y € 

[-en,0], 

NnFniy) < Ce-'^y. 

Applying this to ((75| shows that for every n € N the following estimate holds: 



Then ([7^ follows by letting n,T ^ +00 and recalling that k > a. 
In the next step, we prove that for each fixed e > 0, 

lim (g) = 0. (76) 

n — >oo 

We will prove that there exists a constant C > such that for all n e N and all 
y e [-An - I, -en], 

Fn{y) < Cn'/^N-'e-'^y. (77) 
We may write Fniy) — P[Sn > where /?„ = (5„ + y)/n. Note that 

lim inf /3„ > /? - A = /3o + £. (78) 

n — *oo 

Using the convexity of the function / as in ([5^ . we obtain 

nl{l3n) >cn + ay- log (^ay^2Tr(p"{a)nj . (79) 

Then ([77)1 can be proved as follows: by Lemma O (which is applicable in view 
of dill)) and (|79l), 

Fn{y) < e-"-^^''") < g-™g-ayglog(aV27.v"(a)n) ^ C^VS^-lg-ay ^ 

Now we are in position to start the proof of ([76|). Denote by Kn be the set 
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[-An - 1, -en] H Z. It follows that 

/—en 
'An 

Since K — a>0, the right-hand side converges to as n ^ oo. This proves ([76]) . 
Finally, let us show that for sufficiently small e > 0, 

lim Ji^\e) = 0. (80) 

n — *oo 

We have 

/-An 
N^e^ydF^iy) < iV„e-''^". (81) 
-oo 

So, it suffices to show that kA > c. This can be done as follows. Recall that 
/3o ~ linit^o+ f'it)- By convexity of ip, ip{a) > a^Q. Using this, we obtain 

c = aLp'{a) — (p{a) < a(p'{a) — a^Q — a{P — /Sq) < k{I3 — /Sq). 

Thus, if e is sufficiently small, then c < — /3o — e) = kA. This completes 
the proof of (|80| . 

Now, the proof of Part[l]of the lemma can be completed by letting T +00 
in the decomposition ([66]) and taking into account ((7T|) . ([74)) . ([76)) . ((80)) . The 
proof of Part [2] is similar and will be therefore omitted. 

Let us prove Part [3l Define 

J„(ii,i2) - A^„E[e''(^"-''")lb„+t,<s„<b„+t,]. 
Integration by parts yields 

= -N„. f ' e««dF„(y) 
Jti 



Recalling ((73)) and the assumption k = a, we obtain lim„^oo NnFn{y) — e^"^, 
and the convergence is uniform in y as long as y stays bounded (see Lemma [5]). 
It follows that 

lim J„(ti,t2) = K{t2 - ti), 
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which proves Part [3] of the lemma. □ 

6 Proof of Theorem [4] 

Let Wn — e^"^''"^^, where b'^ = [bn]h, and let Wn,i, ■ • ■ , Wn,N„ be independent 
copies of Wn- Then Theorem 2] is equivalent to the following statement: 

^ W^„„. - i3-M„, ^ /c^cx). (82) 

Note that the random variable Wn takes values in the set exp(/iZ — A). By the 
standard theory of convergence to infinitely divisible distributions, see e.g. [isl 
§25], the convergence in ([55]) will be established once we have verified the validity 
of the following three statements: 

1. For every x S exp(/iZ — A), 

lim iV„,P[iy„, =x] =a;-". (83) 

k — >oo 

2. For the truncated variance, we have 

hm hm sup iV„, Var[W„, lw„^ <r] = 0. (84) 

3. For every t ^ cxp(ft,Z — A), the following limit exists and is finite: 

D^{t) := hm (iV„,E[M^„,l„.„^<,] - B-^An,). (85) 

6.1 Proof of am 



First note that V[Wn ^ x] = ¥[Sn = n/3„], where /3„ = (5;, + A + logx)/n. Note 
also that by (dH), lim„^oo Pn = P- By Part [2] of Theorem H 

=x]^ ^ e-"^(ft'). (86) 
■\/ 2Tr(p"(a)n 

To prove (I83p . we need to find an asymptotic formula for nl{/3n) as n — > c« 
with an error term of the form o(l). We have, by Taylor's expansion, 

I{/3n) = /(/3) + l'{/3){Pn -/3)+ 0{{(3n - Pf), n ^ OO. 

Recall that /3 — f'ia) and hence, /(/3) — c. By Lemma [31 /'(/3) — a. Further, 
recall that 6„ is defined by ^2]) and hence, /3„ — /3 = o(n^^/^) as n oo. Using 
all these facts, we obtain, as n — > oo, 

nI{Pn) ^cn + a{b'^ + A - n/3) + alogx + o(l) 



cn - log{h ^^/2Trip"{a)n) + a{A - A„) + alogx + o(l). 
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By the assumption of the theorem, hm^^^oo = A. Hence, 

"fc^(/3nj = c'^fc - log(/i~^V^27iV^(a)n^) + alogx + o(l), fc oo. (87) 
Applying ([87]) to the right-hand side of (I86p . we obtain that 

P[W„, = - e-^-'a;-", k ~* oo. 
To complete the proof, recall that by ([T|), Nn ~ as n ^ oo. 

6.2 Proof of dH 

It suffices to show that 

hm hm NnMW?,, lw„, <r] = 0. (88) 

Recall that Wn takes values in the set exp(/iZ — A). Using this and then ((83l) . 
we obtain 

hm Nn,E[Wllw„^<r] = lim ^ X^Nn,F[Wn, = x] 

xGcxp(/iZ— A) 

'X<T 

= E (89) 

x(Ecxp(/iZ-— A) 
a:<T 

We have omitted the justification of interchanging the limit and the sum, since 
it can be done as in the proof of Part[l]of Lemma[71 Indeed, this proof is based 
on Lemmas [T] and [2] which are valid both in the lattice and in the non-lattice 
case, and on Lemma[5] which, in the non- lattice case, should be replaced by (|83[) . 
To complete the proof of dH]), let r ^ -HO in ^ and recall that 2 - a > 0. 

6.3 Proof of ([85]) 

Assume that a G (0, 1). Then 

iV„,E[VF„,lH'„,<r] = E xNr,,¥[Wn, = X]. 

a;Gexp(/iZ— A) 

X<.T 

Using (j83p and again omitting the justification of interchanging the sum and 
the limit, we obtain 

lim 7V„,E[IF„,lw <,] = V x^-". 

fc— >oo " 

x(l^cxp(/iZ— A) 

Note that the right-hand side is finite since a e (0, 1). This proves ((85)) in the 
case a e (0,1). We omit the cases a € (1,2) and a ~ 1, since they can be 
handled similarly. 
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7 Proofs of the weak laws of large numbers 
7.1 Proof of Theorem [5] 

We will deduce Theorem [5] from the results of Theorems[l][2j[3l|4]on the limiting 
distributions of Z„, and the following standard lemma. 

Lemma 8. Let Z„ he a sequence of random variables, and let A„,_B„ ^ Q be 
two sequences of normalizing constants such that the following two conditions 
are satisfied: 

1. The random variables {{Z„ ~ A„)/ Bn, n £ N} form a tight sequence. 

2. We have lim„^oo B^/An = 0. 
Then Zn/An 1 as n oo. 

Proof. Fix some e > and S > 0. We have to show that there is A'' = N{e, S) 
such that for all rt > iV, 



1 



> e 



< S. 



By the first assumption of the lemma, we can find m = m{d) such that for all 
n e N, 

Zn A^ 



Bn 



> m 



< S. 



By the second assumption of the lemma, there is = N{e, 6) such that for 
n > N, we have e|A„|/|i?„| > to. This implies that for n > N, 



An 



> 



Ar. 



Bn 



> e 



\Ar. 



\Bn\ 



< 



Zn Ar, 



Bn 



> TO 



< s. 



This completes the proof of the lemma. 



□ 



Proof of Theorem\^ First, we define two normalizing sequences An and Bn as 
follows. If c e [c2,oo), then we set A„ = EZ„ and i?„ = (VarZ„)^/2. If 
c G [ci,C2), then let yl„,_B„ be defined as in Theorem [3] if X is non-lattice and 
as in Theorem |4] if X is lattice. Then, as n — > cx), 



Ari 



EZ„ ~ e('^(i)+'=)", ifoci, 
Af„E[e^"ls„<fcJ - le^vm+ci)n _ lev'(i)", if c = Ci. 



(90) 



Note that the case c = ci follows from Part [T] of Lemma [H Using this, we may 
rewrite (fT3)) as follows: 

■p 

Zn/An ^1, 71 ^ OO. (91) 

By Theorems m [2l El |4] (see also Corollary [1]) , the random variables {{Zn — 
An)/ Bn, n G N} form a tight sequence (and even a convergent sequence, unless 
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c G [ci,C2) and the distribution of X is lattice). Thus, the first assumption of 
Lemma [8] is satisfied. 

To prove (pij) . it suffices to show that the second assumption of Lemma |S] is 
fulfiUed, i.e. 

hm Br,/ An = 0. (92) 
Assume first that c > C2 . We have 

Bn = (VarZ„)i/2 < 7V,y2(E[e2S„])i/2 _ g((c+^(2))/2)„^ n^oo. 

Hence, to prove ((92| . it suffices to show that (c+ (p{2))/2 < c + (p{l)- We have 

c > C2 = 2^'(2) - ^(2) > 2(^(2) - ^(1)) - ^(2) - ^(2) - 2vj(l), 

where we have used that (p'{2) > (p{2) — (p{l) by the strict convexity of ip. It 
follows that 

2(c + ip{l)) - (c + ip{2)) = c + 2(^(1) - (^(2) > 0, 

which proves ([92]) and verifies the second assumption of Lemma [H 

Assume now that c € (ci,C2). Then v4„ = EZ„ and i?„ is defined by (jlOp 
or (112). In both cases, 

S„ e''" = o(e''"), n ^ oo. 

To prove ([M]) . it suffices to show that (3 < c+ (p{l). We have 

c+tp{l) - (3^ aip'{a) - Lp{a) + ip{l) - </?'(«) = (a - l)^p'{a) ~ {Lp{a) - ip{l)). 

By convexity of f, and by the fact that a > 1 (which follows from c > ci), the 
right-hand side is positive. This proves ((92|) . 

Finally, assume that c = ci. By (HO]), An ^ (l/2)e'^'(i)" as n ^ oo. On 
the other hand, by ^ and S„ = 0(6/^") = o(e'^'(i)") as n -> cx). This 

completes the proof of ([5^ and the proof of (PT|) . □ 

7.2 Proof of Remark [4] 

The proof of Remark |4] will follow from the following standard lemma. 

Lemma 9. Let {Yn,n G N} be a tight sequence of positive random variables, 
and assume that there is no constant x which is a weak accumulation point of 
{Yn,n G N}. Then there is no sequence On > with 

Yn/On^l, n^oo. (93) 
Proof. Assume first that lim„^oo — 00. Then 

lim F[Yn/an > 1/2] = lim P[y„ > a„/2] = 0, 
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where the last equahty follows from the tightness of the sequence n S N}. 
Hence, Eg 1931 cannot hold in this case. Assume now that lim„^oo in = 0. Then 

liminf P[y„/a„ < 2] = liminf P[r„ < 2a„] < 1, 

-p 

where the last equahty fohows from the assumption that Yn 0. Hence, Eg 1951 
cannot hold m this case too. Assume now that lim.^^oo = ^5 where a > 0. 
Then EqlHSlis not fulfilled since we have assumed that Yn ^ a. 

Now let the sequence a„ be arbitrary. Then it has a subsequence which 
converges either to oo, or to 0, or to some limit a > 0. Applying the above 
considerations, we see that cannot hold. □ 

Proof of Remark^ Let Bn be defined as in Theorem [H resp. as in Theorem IH 
in the non-lattice, resp. in the lattice case. Then by Theorems [3] and S] applied 
in the case c < ci, the sequence Yn := Z„/_B„ satisfies the assumptions of 
Lemma [HI The statement of Remark S] follows. □ 



7.3 Proof of Theorem M 



First of all, note that the case c > ci follows from Theorem [S] Let us consider 
the case c S (0, Ci). Define i?„ as in PU)) . resp. as in (O, in the non-lattice, 
resp. in the lattice case. Fix some £ > 0. We show that 



lim ] 

n — >QQ 



1 



log Zn > P + e 



= 0. 



(94) 



By Theorem 13] and Theorem SI the family of random variables {Zn/Bn,n g 
N} is tight (and, in the non-lattice case, even convergent). Therefore, if m„ is 
a sequence with lim„_^oo m„ = oo, then 



lim 



Zn 

> nin 



= 0. 



(95) 



We have 



1 



log Zn> P + e 



Zn> e 



Zr^ e(^+")^ 



Using dill) and the fact that by ^ and dH]), B„ = o(e(^+^)") as n -> oo, we 
arrive at (|94| . 

It remains to prove that 



lim 



1 



We have 



1 



■ log Z„ < /5 - £ 



logZ„ <(3-e 



Zn < e^^-'> 



0. 



(96) 



Zn ^ e^P-^> 

Bn Bn 
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From the description of weak accumulation points of the sequence {Zn/Bn, n G 
N} given in Theorem [3] and Theorem |4] it follows that for every sequence m„ 
such that lini„_,oo rn-n = 0, we have 



lim I 

n — >oo 



Bn 



< rrir. 



= 0. (97) 



Using this and the fact that by (fTO]) and p2|). e'^^ = o{Bn) as n ^ oo, we 
obtain ((96|) . This completes the proof. 

7.4 Proof of Proposition [T] 

First of all note that /+ is well-defined in a neighborhood of ci. We show that 
/+(ci) = /-(ci). Recah that a = /((/?'(!)) = '/''(I) - "^(l)- Using this, we 
obtain 

/+(ci) = /-i(ci) = ^'(1) = ^(1) + Ci = /_(ci). 

Let us prove that /+(ci) = f'_{ci). By LemmaO /'((^'(l)) = 1. By the formula 
for the derivative of the inverse function, 



/;(ci) = (/-^(x))'i. 



1 



/'(/-i(ci)) /'(^'(l)) 



Finally, let us show that /"(ci) ^ /"(ci). To this end note that /_ is linear, 
whereas /+ is strictly concave as an inverse of a is strictly convex function /. 
This implies that f'l{ci) = and /^(ci) < 0. 
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